Image conversion apparatus and image conversion method

ABSTRACT

According to one embodiment, an image conversion apparatus includes a 3D conversion instruction module, a determination module, and a converter. The 3D conversion instruction module is configured to instruct execution of a 3D conversion required to convert an input image into a 3D image. The determination module is configured to determine validity or invalidity of the 3D conversion instruction based on whether the input image corresponds to a 3D image format or a 2D image format. The converter is configured to convert, based on validity determination of the 3D conversion instruction, the input image into the 3D image in response to the 3D conversion instruction.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based upon and claims the benefit of priority fromJapanese Patent Application No. 2010-125133, filed May 31, 2010; theentire contents of which are incorporated herein by reference.

FIELD

Embodiments described herein relate generally to an image conversionapparatus and image conversion method.

BACKGROUND

Nowadays, a full-fledged television which can display three-dimensional(3D) images (to be referred to as a 3D television hereinafter) is aboutto come into the market. Various techniques required to display 3Dimages have been disclosed and put into practical use so far. However,since the brightness and resolution of a 3D image are inferior to thoseof a two-dimensional (2D) image, 3D televisions are unfamiliar.

However, in recent years, due to the advent of large-capacity opticaldiscs such as a Blu-ray (BD®) and the prevalence of full-HD televisions,3D images having high image quality can be played back by, for example,a frame sequential method.

Therefore, the 3D televisions will become widespread exponentially inthe future. However, the amount of available 3D image content is stillsmall. Against such a background, a technique for converting 2D imagecontent into 3D image content, and generating pseudo-3D images based onthe converted 3D image content (2D-3D conversion technique) has beendisclosed.

As described above, the 2D-3D conversion technique has been disclosed,and televisions incorporating the 2D-3D conversion technique have beenproposed. However, various playback apparatuses may be connected to atelevision, and miscellaneous image content may be input to thetelevision.

A technique which controls 2D-3D conversion according to input imagecontent has not been disclosed yet. The user does not always want toview a converted image (for example, a 3D image), and often wants toview an original image (for example, a 2D image). A technique whichcontrols 2D-3D conversion as the situation demands has not beendisclosed yet.

BRIEF DESCRIPTION OF THE DRAWINGS

A general architecture that implements the various features of theembodiments will now be described with reference to the drawings. Thedrawings and the associated descriptions are provided to illustrate theembodiments and not to limit the scope of the invention.

FIG. 1 is a block diagram showing an example of an image display systemcommon to the first to third embodiments;

FIG. 2 is a view showing an example of a remote controller compatiblewith an image display apparatus shown in FIG. 1;

FIG. 3 is a view showing an example of a remote controller compatiblewith an image playback apparatus shown in FIG. 1;

FIG. 4 is a table showing first to fourth image conversion controlexamples to be described in the first embodiment;

FIG. 5 is a flowchart showing the first to fourth image conversioncontrol examples to be described in the first embodiment;

FIG. 6 is a table showing fifth and sixth image conversion controlexamples and first and second recording control examples to be describedin the second embodiment; and

FIG. 7 is a flowchart showing the fifth and sixth image conversioncontrol examples and first and second recording control examples to bedescribed in the second embodiment.

DETAILED DESCRIPTION

Various embodiments will be described hereinafter with reference to theaccompanying drawings.

In general, according to one embodiment, an image conversion apparatusincludes a 3D conversion instruction module, a determination module, anda converter. The 3D conversion instruction module is configured toinstruct execution of a 3D conversion required to convert an input imageinto a 3D image. The determination module is configured to determinevalidity or invalidity of the 3D conversion instruction based on whetherthe input image corresponds to a 3D image format or a 2D image format.The converter is configured to convert, based on validity determinationof the 3D conversion instruction, the input image into the 3D image inresponse to the 3D conversion instruction.

The first to third embodiments will be described hereinafter withreference to the drawings.

FIG. 1 is a block diagram showing an example of an image display systemcommon to the first to third embodiments. As shown in FIG. 1, the imagedisplay system is configured by, for example, an image display apparatus1 and image playback apparatus 2. The image display apparatus 1 is, forexample, a digital television receiver. The image playback apparatus 2is, for example, a DVD player, BD player, or set-top box.

The image display apparatus 1 includes a controller (control module) 11,interface 12, image processing module 13, input unit 14, signalreceiving unit 15, interface 16, storage device 17, tuner 18, and liquidcrystal panel 19. The image playback apparatus 2 includes a controller(control module) 21, interface 22, image processing module 23, inputunit 24, signal receiving unit 25, interface 26, storage device 27, andtuner 28. The storage devices 17 and 27 include, for example, a DVD, BD,or HDD.

The image display apparatus 1 is configured to be connectable to theimage playback apparatus 2 (that is, the interface 22) via the interface12. In other words, the image playback apparatus 2 is configured to beconnectable to the image display apparatus 1 (that is, the interface 12)via the interface 22.

The interfaces 12 and 22 are two-way communication units, and areinterfaces which are compliant with, for example, the High-DefinitionMultimedia Interface (HDMI®) standard. The image playback apparatus 2can transmit image and audio signals to the image display apparatus 1via the interface 22, and the image display apparatus 1 can receive theimage and audio signals transmitted from the image playback apparatus 2via the interface 12. Furthermore, the HDMI standard specifies aConsumer Electronics Control (HDMI-CEC) standard. By the HDMI-CECfunctions of the interfaces 12 and 22, the controller 21 of the imageplayback apparatus 2 can transmit control signals to the image displayapparatus 1 via the interface 22, and the image display apparatus 1 canreceive the control signals transmitted from the image playbackapparatus 2 via the interface 12. Then, the controller 11 of the imagedisplay apparatus 1 can control various operations based on the receivedcontrol signals.

As described above, the interfaces 12 and 22 are configured to exchangecontrol signals. With this configuration, when the image displayapparatus 1 and image playback apparatus 2 are connected via theinterfaces 12 and 22, the controller 11 of the image display apparatus 1can notify the image playback apparatus 2 of the processing capabilityof the image processing module 13 via the interfaces 12 and 22, and thecontroller 21 of the image playback apparatus 2 can notify the imagedisplay apparatus 1 of the processing capability of the image processingmodule 23 via the interfaces 12 and 22.

That is, when the image display apparatus 1 and image playback apparatus2 are connected via the interfaces 12 and 22, the controller 11 of theimage display apparatus 1 can detect connection of the image playbackapparatus 2 and also the processing capability of the image processingmodule 23. Also, the controller 21 of the image playback apparatus 2 candetect connection of the image display apparatus 1 and also theprocessing capability of the image processing module 13.

The input unit 14 includes a plurality of keys such as a 3D conversionkey (2D→3D conversion key) 141 and 2D conversion key (3D→2D conversionkey) 142. The 3D conversion key 141 is a key used to instruct executionof 3D conversion for converting an input image into a 3D image. The 2Dconversion key 142 is a key used to instruct execution of 2D conversionfor converting an input image into a 2D image. The signal receiving unit15 receives a signal from a remote controller 150 shown in FIG. 2. Asshown in FIG. 2, the remote controller 150 includes a plurality of keyssuch as a 3D conversion key (2D→3D conversion key) 151 and 2D conversionkey (3D→2D conversion key) 152. The 3D conversion key 151 issubstantially the same as the 3D conversion key 141, and a descriptionof its function will not be given. Also, the 2D conversion key 152 issubstantially the same as the 2D conversion key 142, and a descriptionof its function will not be given.

Note that, for example, a single 2D/3D conversion key may be arranged inplace of the 3D conversion key 141 and 2D conversion key 142. Forexample, when the user presses this 2D/3D conversion key once, the 2D/3Dconversion key issues a 3D conversion instruction for converting aninput image into a 3D image. When the user presses this 2D/3D conversionkey twice successively, the 2D/3D conversion key issues a 2D conversioninstruction for converting an input image into a 2D image.

Likewise, the input unit 24 includes a plurality of keys such as a 3Dconversion key (2D→3D conversion key) 241 and 2D conversion key (3D→2Dconversion key) 242. The signal receiving unit 25 receives a signal froma remote controller 250 shown in FIG. 3. As shown in FIG. 3, the remotecontroller 250 includes a plurality of keys such as a 3D conversion key(2D→3D conversion key) 251 and 2D conversion key (3D→2D conversion key)252. Furthermore, for example, a single 2D/3D conversion key may bearranged in place of the 3D conversion key 241 and 2D conversion key242.

The image processing module 23 includes a 3D conversion processingmodule 231, 2D conversion processing module 232, and guidanceinformation output module 233. The 3D conversion processing module 231converts an original image signal (2D image signal) from the storagedevice 27 or tuner 28 into a 3D image signal, and outputs the 3D imagesignal. That is, the 3D conversion processing module 231 converts anoriginal image signal (2D image signal) input via the interface 26 intoa 3D image signal, and outputs the 3D image signal.

The 2D conversion processing module 232 converts an original imagesignal (3D image signal) from the storage device 27 or tuner 28 into a2D image signal, and outputs the 2D image signal. That is, the 2Dconversion processing module 232 converts an original image signal (3Dimage signal) input via the interface 26 into a 2D image signal, andoutputs the 2D image signal. The guidance information output module 233outputs guidance image signals corresponding to various kinds ofguidance information.

Note that the image processing module 23 can output a 2D-converted 2Dimage signal or 3D-converted 3D image signal, as described above, andcan also output an original image signal (2D or 3D image signal) intact.

The interface 22 can output a 2D image signal, 3D image signal, orguidance image signal output from the image processing module 23.Alternatively the interface 22 can output a 2D composite image signalobtained by compositing a 2D image signal and guidance image signal, ora 3D composite image signal obtained by compositing a 3D image signaland guidance image signal. Alternatively the interface 22 outputs anoriginal image signal (2D or 3D image signal).

The interface 12 can receive the aforementioned 2D image signal, 3Dimage signal, or guidance image signal. Alternatively the interface 12can receive the aforementioned 2D or 3D composite image signal.Alternatively the interface 12 can receive the original image signal (2Dor 3D image signal).

The image processing module 13 includes a 3D conversion processingmodule 131, 2D conversion processing module 132, and guidanceinformation output module 133. The 3D conversion processing module 131converts an input image signal (2D image signal or 2D composite imagesignal) input via the interface 12 or tuner 18 into a 3D image signal,and outputs the 3D image signal. The 2D conversion processing module 132converts an input image signal (3D image signal or 3D composite imagesignal) input via the interface 12 or tuner 18 into a 2D image signal,and outputs the 2D image signal. The guidance information output module133 outputs guidance image signals corresponding to various kinds ofguidance information.

The liquid crystal panel 19 displays an image based on at least oneimage signal of a 2D image signal and guidance image signal output fromthe image processing module 13. For example, when the image processingmodule 13 composites a 2D image signal and guidance image signal andoutputs a 2D composite image signal, the liquid crystal panel 19 candisplay a 2D image corresponding to the 2D image signal, and a guidanceimage corresponding to the guidance image signal to be superimposed onthe displayed 2D image.

Alternatively the liquid crystal panel 19 displays an image based on atleast one image signal of a 3D image signal and guidance image signaloutput from the image processing module 13. For example, when the imageprocessing module 13 composites a 3D image signal and guidance imagesignal and outputs a 3D composite image signal, the liquid crystal panel19 can display a 3D image corresponding to the 3D image signal, and aguidance image corresponding to the guidance image signal to besuperimposed on the displayed 3D image.

Note that 3D conversion processing and 2D conversion processingdisclosed in, for example, Jpn. Pat. Appln. KOKAI Publication No.2006-121553 can be applied to the 3D conversion processing in the 3Dconversion processing modules 131 and 231 and the 2D conversionprocessing in the 2D conversion processing modules 132 and 232.

The image conversion control by the image display apparatus 1 will bedescribed below.

As described above, the input unit 14 of the image display apparatus 1includes the 3D conversion key (2D→3D conversion key) 141 and 2Dconversion key (3D→2D conversion key) 142. The user who wants to displaya 3D image presses, for example, the 3D conversion key 141. In responseto the pressing of the 3D conversion key 141, the input unit 14 issues a3D conversion instruction to the controller 11. The controller 11determines based on various conditions whether or not the 3D conversioninstruction is valid. When it is determined that the 3D conversioninstruction is valid, the controller 11 issues the 3D conversioninstruction to the image processing module 13.

The user who wants to display a 2D image for the reason that he or shedoes not want to use 3D spectacles presses, for example, the 2Dconversion key 142. In response to the pressing of the 2D conversion key142, the input unit 14 issues a 2D conversion instruction to thecontroller 11. The controller 11 determines based on various conditionswhether or not the 2D conversion instruction is valid. When it isdetermined that the 2D conversion instruction is valid, the controller11 issues the 2D conversion instruction to the image processing module13.

For example, the controller 11 determines based on at least one of thetype of an input image signal input to the image processing module 13and an image conversion capability of the image playback apparatus 2whether or not the 3D conversion instruction is valid and whether or notthe 2D conversion instruction is valid (see FIGS. 4 and 5). This controlwill be described in detail below.

First Embodiment

(1) First image conversion control executed when a 3D conversioninstruction is input by the 3D conversion key 141 of the image displayapparatus 1 (YES in BLOCK 101) is as follows.

When the controller 11 detects that an input image signal input to theimage processing module 13 is a 2D image signal (2D image format) (YESin BLOCK 111), it determines that the 3D conversion instruction isvalid, and instructs the image processing module 13 to execute the 3Dconversion. Then, the 3D conversion processing module 131 of the imageprocessing module 13 converts the input image signal into a 3D imagesignal, and outputs the 3D image signal (BLOCK 114). The liquid crystalpanel 19 displays a 3D image based on the converted 3D image signal(BLOCK 115). That is, when the controller 11 detects that a source imagecorresponds to 2D content, it determines that the 3D conversioninstruction is valid.

When the controller 11 detects that an input image signal input to theimage processing module 13 is a 3D image signal (3D image format) (YESin BLOCK 121), it determines that the 3D conversion instruction isinvalid, and does not issue any 3D conversion instruction to the imageprocessing module 13. Then, the 3D conversion processing module 131 ofthe image processing module 13 does not convert the input image signalinto a 3D image signal. Hence, the image processing module 13 outputsthe input image signal intact, and the liquid crystal panel 19 displaysan image based on the input image signal (BLOCK 125). That is, when thecontroller 11 detects that a source image corresponds to 3D content, itdetermines that the 3D conversion instruction is invalid. In this case,since the input image signal is a 3D image signal, the controller 11 canalso control to output guidance information indicating that the 3Dconversion instruction is canceled, and the input image signal isdisplayed intact.

(2) Second image conversion control executed when a 3D conversioninstruction is input by the 3D conversion key 141 of the image displayapparatus 1 (YES in BLOCK 101) is as follows.

When the controller 11 detects that an input image signal input to theimage processing module 13 is a 2D image signal (2D image format) (YESin BLOCK 111), and also detects that 3D conversion processing by the 3Dconversion processing module 231 of the image playback apparatus 2 isset (YES in BLOCK 112), it instructs the image playback apparatus 2(source apparatus of the input image signal) to stop (cancel) the 3Dconversion processing via the interface 12 (BLOCK 113). Furthermore, thecontroller 11 determines that the 3D conversion instruction is valid,and instructs the image processing module 13 to execute 3D conversion.

Alternatively when the controller 11 detects that an input image signalinput to the image processing module 13 is a 3D image signal (3D imageformat), and also detects that the 3D image signal is an image signal3D-converted by the 3D conversion processing module 231 of the imageplayback apparatus 2, it instructs the image playback apparatus 2(source apparatus of the input image signal) to stop (cancel) the 3Dconversion processing via the interface 12. Furthermore, the controller11 determines that the 3D conversion instruction is valid, and instructsthe image processing module 13 to execute 3D conversion.

The controller 21 of the image playback apparatus 2 receives the cancelinstruction via the interface 22, and instructs the 3D conversionprocessing module 231 to cancel the 3D conversion processing. Inresponse to this, the image processing module 23 outputs an originalimage signal (2D image signal). That is, the image display apparatus 1can receive the original image signal (2D image signal) via theinterface 12, and the image processing module 13 can receive theoriginal image signal (2D image signal). Also, since the imageprocessing module 13 receives the 3D conversion instruction from thecontroller 11, the 3D conversion processing module 131 converts theoriginal image signal (2D image signal) into a 3D image signal, andoutputs the 3D image signal (BLOCK 114). The liquid crystal panel 19displays a 3D image based on the converted 3D image signal (BLOCK 115).

Also, when the controller 11 detects that an input image signal input tothe image processing module 13 is a 3D image signal (3D image format)(YES in BLOCK 121), and also detects that 2D conversion processing bythe 2D conversion processing module 232 of the image playback apparatus2 is set (YES in BLOCK 122), it instructs the image playback apparatus 2(source apparatus of the input image signal) to stop (cancel) the 2Dconversion processing via the interface 12 (BLOCK 123). Furthermore, thecontroller 11 determines that the 3D conversion instruction is invalid,and does not issue any 3D conversion instruction to the image processingmodule 13.

Alternatively when the controller 11 detects that an input image signalinput to the image processing module 13 is a 2D image signal (2D imageformat), and also detects that the 2D image signal is an image signal2D-converted by the 2D conversion processing module 232 of the imageplayback apparatus 2, it instructs the image playback apparatus 2(source apparatus of the input image signal) to stop (cancel) the 2Dconversion processing via the interface 12. Furthermore, the controller11 determines that the 3D conversion instruction is invalid, and doesnot issue any 3D conversion instruction to the image processing module13.

The controller 21 of the image playback apparatus 2 receives the cancelinstruction via the interface 22, and instructs the 2D conversionprocessing module 232 to cancel the 2D conversion processing. Inresponse to this, the image processing module 23 outputs an originalimage signal (3D image signal). That is, the image display apparatus 1can receive the original image signal (3D image signal) via theinterface 12, and the image processing module 13 can receive theoriginal image signal (3D image signal). Since the image processingmodule 13 does not receive any 3D conversion instruction from thecontroller 11, it outputs the input image signal intact, and the liquidcrystal panel 19 displays an image based on the input image signal(BLOCK 125). In this case, since the input image signal is a 3D imagesignal, the controller 11 can also control to output guidanceinformation indicating that the 3D conversion instruction is canceled,and the input image signal is displayed intact.

(3) Third image conversion control executed when a 2D conversioninstruction is input by the 2D conversion key 142 of the image displayapparatus 1 (YES in BLOCK 102) is as follows.

When the controller 11 detects that an input image signal input to theimage processing module 13 is a 3D image signal (3D image format) (YESin BLOCK 131), it determines that the 2D conversion instruction isvalid, and instructs the image processing module 13 to execute 2Dconversion. Then, the 2D conversion processing module 132 of the imageprocessing module 13 converts the input image signal into a 2D imagesignal, and outputs the 2D image signal (BLOCK 134), and the liquidcrystal panel 19 displays a 2D image based on the converted 2D imagesignal (BLOCK 135). That is, when the controller 11 detects that asource image corresponds to 3D content, it determines that the 2Dconversion instruction is valid.

When the controller 11 detects that an input image signal input to theimage processing module 13 is a 2D image signal (2D image format) (YESin BLOCK 141), it determines that the 2D conversion instruction isinvalid, and does not issue any 2D conversion instruction to the imageprocessing module 13. Then, the 2D conversion processing module 132 ofthe image processing module 13 does not convert the input image signalinto a 2D image signal. Hence, the image processing module 13 outputsthe input image signal intact, and the liquid crystal panel 19 displaysan image based on the input image signal (BLOCK 145). That is, when thecontroller 11 detects that a source image corresponds to 2D content, itdetermines that the 2D conversion instruction is invalid. In this case,since the input image signal is a 2D video signal, the controller 11 canalso control to output guidance information indicating that the 2Dconversion instruction is canceled, and the input image signal isdisplayed intact.

(4) Fourth image conversion control executed when a 2D conversioninstruction is input by the 2D conversion key 142 of the image displayapparatus 1 (YES in BLOCK 102) is as follows.

When the controller 11 detects that an input image signal input to theimage processing module 13 is a 3D image signal (3D image format) (YESin BLOCK 131), and also detects that 2D conversion processing by the 2Dconversion processing module 232 of the image playback apparatus 2 isset (YES in BLOCK 132), it instructs the image playback apparatus 2(source apparatus of the input image signal) to stop (cancel) the 2Dconversion processing via the interface 12 (BLOCK 133). Furthermore, thecontroller 11 determines that the 2D conversion instruction is valid,and instructs the image processing module 13 to execute 2D conversion.

Alternatively when the controller 11 detects that an input image signalinput to the image processing module 13 is a 2D image signal (2D imageformat), and also detects that the 2D image signal is an image signal2D-converted by the 2D conversion processing module 232 of the imageplayback apparatus 2, it instructs the image playback apparatus 2(source apparatus of the input image signal) to stop (cancel) the 2Dconversion processing via the interface 12. Furthermore, the controller11 determines that the 2D conversion instruction is valid, and instructsthe image processing module 13 to execute 2D conversion.

The controller 21 of the image playback apparatus 2 receives the cancelinstruction via the interface 22, and instructs the 2D conversionprocessing module 232 to cancel the 2D conversion processing. Inresponse to this, the image processing module 23 outputs an originalimage signal (3D image signal). That is, the image display apparatus 1can receive the original image signal (3D image signal) via theinterface 12, and the image processing module 13 can receive theoriginal image signal (3D image signal). Also, since the imageprocessing module 13 receives the 2D conversion instruction from thecontroller 11, the 2D conversion processing module 132 converts theoriginal image signal (3D image signal) into a 2D image signal, andoutputs the 2D image signal (BLOCK 134). The liquid crystal panel 19displays a 2D image based on the converted 2D image signal (BLOCK 135).

Also, when the controller 11 detects that an input image signal input tothe image processing module 13 is a 2D image signal (2D image format)(YES in BLOCK 141), and also detects that 3D conversion processing bythe 3D conversion processing module 231 of the image playback apparatus2 is set (YES in BLOCK 142), it instructs the image playback apparatus 2(source apparatus of the input image signal) to stop (cancel) the 3Dconversion processing via the interface 12 (BLOCK 143). Furthermore, thecontroller 11 determines that the 2D conversion instruction is invalid,and does not issue any 2D conversion instruction to the image processingmodule 13.

Alternatively when the controller 11 detects that an input image signalinput to the image processing module 13 is a 3D image signal (3D imageformat), and also detects that the 3D image signal is an image signal3D-converted by the 3D conversion processing module 232 of the imageplayback apparatus 2, it instructs the image playback apparatus 2(source apparatus of the input image signal) to stop (cancel) the 3Dconversion processing via the interface 12. Furthermore, the controller11 determines that the 2D conversion instruction is invalid, and doesnot issue any 2D conversion instruction to the image processing module13.

The controller 21 of the image playback apparatus 2 receives the cancelinstruction via the interface 22, and instructs the 3D conversionprocessing module 231 to cancel the 3D conversion processing. Inresponse to this, the image processing module 23 outputs an originalimage signal (2D image signal). That is, the image display apparatus 1can receive the original image signal (2D image signal) via theinterface 12, and the image processing module 13 can receive the imageprocessing module 13. Since the image processing module 13 does notreceive any 2D conversion instruction from the controller 11, it outputsthe input image signal intact, and the liquid crystal panel 19 displaysan image based on the input image signal (BLOCK 145). In this case,since the input image signal is a 2D image signal, the controller 11 canalso control to output guidance information indicating that the 2Dconversion instruction is canceled, and the input image signal isdisplayed intact.

(5) Type determination of an input image signal is executed as follows.

The controller 11 can detect based on attribute information (that in aheader) in input image data including an input image signal whether theinput image signal corresponds to a 3D image signal (3D image format) ora 2D image signal (2D image format). Alternatively the image processingmodule analyzes, for example, the frame configuration of the input imagesignal, and can detect whether the input image signal corresponds to a3D image signal (3D image format) or a 2D image signal (2D imageformat). For example, based on the analysis result of the input imagesignal, when it is revealed by comparing images of even and odd frameswhich configure the input image signal that the output format of theinput image signal is a format for alternately outputting images of evenand odd frames for the right and left eyes, it can be determined thatthe input image signal corresponds to a 3D image signal (3D imageformat).

Also, the controller 11 can detect based on attribute information (thatin a header) in input image data including an input image signal whetherthe input image signal corresponds to a 3D image signal 3D-converted bya device such as the image playback apparatus 2 or a 2D image signal2D-converted by a device such as the image playback apparatus 2.

With the aforementioned processing, the image display apparatus 1 canappropriately control the image conversion as the situation demands. Forexample, even when a 3D conversion instruction input, if an input imagesignal is a 3D image signal (3D image format), the image displayapparatus 1 determines that the 3D conversion instruction is invalid.Then, the 3D image signal can be prevented from undergoing another 3Dconversion.

When an input image signal is a 3D image signal (3D image format) whichhas undergone the 3D conversion processing by the image playbackapparatus 2, or when an input image signal is about to undergo the 3Dconversion processing by the image playback apparatus 2, the imagedisplay apparatus 1 instructs the image playback apparatus 2 to stop the3D conversion processing in response to the 3D conversion instruction,and then determines that the 3D conversion instruction is valid (thatis, it determines that the 3D conversion processing by the 3D conversionprocessing module 131 is valid). Then, a 3D image signal supplied fromthe image playback apparatus 2 can be prevented from undergoing another3D conversion by the 3D conversion processing module 131 of the imagedisplay apparatus 1.

Note that when the image display apparatus 1 compares a 3D conversionprocessing capability of the 3D conversion processing module 131 (to bereferred to as a self 3D conversion processing capability hereinafter)and that of the 3D conversion processing module 231 (to be referred toas a partner's 3D conversion processing capability), and determines thatthe self 3D conversion processing capability is superior to thepartner's 3D conversion processing capability, it may instruct the imageplayback apparatus 2 to stop the 3D conversion processing in response tothe 3D conversion instruction, and may then determine that the 3Dconversion instruction is valid, as described above.

When the image display apparatus 1 determines that the self 3Dconversion processing capability is inferior to the partner's 3Dconversion processing capability, it may instruct the image playbackapparatus 2 to execute the 3D conversion processing in response to the3D conversion instruction, and may then determine that the 3D conversioninstruction is invalid.

Likewise, even when a 2D conversion instruction is input, if an inputimage signal is a 2D image signal (2D image format), the image displayapparatus 1 determines that the 2D conversion instruction is invalid. Inthis way, the 2D image signal can be prevented from undergoing another2D conversion.

Second Embodiment

With 3D televisions likely to become exponentially prevalent, it isexpected that as package media (cell videos) offered by a contentprovider, 2D-image package media and 3D-image package media of identicalcontent will be available in parallel in the future.

When 2D images of the 2D-image package media are converted into 3Dimages, their image quality often drops, and it is often proper to playback the 2D images of the 2D-image package media intact. Alternativelyit is often proper to play back original 2D images prepared by thecontent provider intact.

Likewise, when 3D images of the 3D-image package media are convertedinto 2D images, their image quality often drops, and it is often properto play back the 3D images of the 3D-image package media intact.Alternatively it is often proper to play back original 3D imagesprepared by the content provider intact.

Conventionally, it is not supposed to deal the 2D- and 3D-image packagemedia. Also, it is not supposed that 2D images of the 2D-image packagemedia are converted into 3D images or 3D images of the 3D-package mediaare converted into 2D images due to the practical application of the2D-3D conversion technique. That is, image conversion control requiredto appropriately play back 2D- and 3D-image package media has not beendiscussed.

Fifth and sixth image conversion control processes required toappropriately play back the 2D- and 3D-image package media will bedescribed below (see FIGS. 6 and 7)

(1) Fifth image conversion control executed when a 3D conversioninstruction is input by the 3D conversion key 141 of the image displayapparatus 1 (YES in BLOCK 201) is as follows.

When the controller 11 detects that an input image signal input to theimage processing module 13 is an original 2D image signal (2D imageformat) which has never undergone 2D conversion processing, itdetermines that the 3D conversion instruction is valid, and instructsthe image processing module 13 to execute 3D conversion. For example,when the controller 11 detects that an input image signal is an original2D image signal (2D image format) of a package medium (commerciallyavailable) (YES in BLOCK 211), or that an input image signal is anoriginal 2D image signal (2D image format) of a non-package medium (notcommercially available), which has never undergone the 2D conversionprocessing (YES in BLOCK 221, NO in BLOCK 222), it determines that the3D conversion instruction is valid, and instructs the image processingmodule 13 to execute 3D conversion.

Then, the 3D conversion processing module 131 of the image processingmodule 13 converts the input image signal into a 3D image signal, andoutputs the 3D image signal (BLOCK 213, BLOCK 233), and the liquidcrystal panel 19 displays a 3D image based on the converted 3D imagesignal (BLOCK 214, BLOCK 234). That is, when the controller 11 detectsthat a source image corresponds to original 2D content which has neverundergone 2D conversion processing, it determines that the 3D conversioninstruction is valid. Note that when the controller 11 detects that aninput image signal is a copyrighted 2D image signal, it can judge thatthis input image signal is a 2D image signal of a package medium.

Alternatively when the controller 11 detects that an input image signalinput to the image processing module 13 is a non-original 2D-convertedimage signal (2D image format) (YES in BLOCK 222), it determines thatthe 3D conversion instruction is invalid. Alternatively when thecontroller 11 detects that an input image signal input to the imageprocessing module 13 is a 3D image signal (3D image format) (YES inBLOCK 241), it also determines that the 3D conversion instruction isinvalid. For example, when the controller 11 detects that an input imagesignal is a 3D image signal (3D image format) of a package medium(commercially available), that an input image signal is a 3D imagesignal (3D image format) of a non-package medium (not commerciallyavailable), or that an input image signal is a non-original 3D-convertedimage signal (3D image format), it determines that the 3D conversioninstruction is invalid.

As a result, the 3D conversion processing module 131 of the imageprocessing module 13 does not convert the input image signal into a 3Dimage signal. Hence, the image processing module 13 outputs the inputimage signal intact, and the liquid crystal panel 19 displays an imagebased on the input image signal (BLOCK 224, BLOCK 244). Note that whenthe controller 11 detects that an input image signal is a copyrighted 3Dimage signal, it can judge that this input image signal is a 3D imagesignal of a package medium.

The non-original 2D-converted image signal is, for example, an imagesignal which was previously 2D-converted by the 2D conversion processingmodule 132 or that which was previously 2D-converted by the 2Dconversion processing module 232. Likewise, the non-original3D-converted image signal is, for example, an image signal which waspreviously 3D-converted by the 3D conversion processing module 131 orthat which was previously 3D-converted by the 3D conversion processingmodule 231.

(2) Sixth image conversion control executed when a 2D conversioninstruction is input by the 2D conversion key 142 of the image displayapparatus 1 (YES in BLOCK 202) is as follows.

When the controller 11 detects that an input image signal input to theimage processing module 13 is an original 3D image signal (3D imageformat), which has never undergone 3D conversion processing, it isdetermined that a 2D conversion instruction is valid, and instructs theimage processing module 13 to execute 2D conversion. For example, whenthe controller 11 detects that an input image signal is an original 3Dimage signal (3D image format) of a package medium (commerciallyavailable) (YES in BLOCK 251) or that an input image signal is anoriginal 3D image signal (3D image format), which has never undergone 3Dconversion processing, of a non-package medium (not commerciallyavailable) (NO in BLOCK 262), it determines that the 2D conversioninstruction is valid, and instructs the image processing module 13 toexecute 2D conversion.

Thus, the 2D conversion processing module 132 of the image processingmodule 13 converts the input image signal into a 2D image signal, andoutputs the 2D image signal (BLOCK 253, BLOCK 273), and the liquidcrystal panel 19 displays a 2D image based on the converted 2D imagesignal (BLOCK 254, BLOCK 274). That is, when the controller 11 detectsthat a source image corresponds to original 3D content which has neverundergone the 3D conversion processing, it determines that the 2Dconversion instruction is valid. Note that when the controller 11detects that an input image signal is a copyrighted 3D image signal, itcan judge that this input image signal is a 3D image signal of a packagemedium.

Alternatively when the controller 11 detects that an input image signalinput to the image processing module 13 is a non-original 3D-convertedimage signal (3D image format) which has undergone the 3D conversionprocessing (YES in BLOCK 262), it determines that the 2D conversioninstruction is invalid. Alternatively when the controller 11 alsodetects that an input image signal input to the image processing module13 is a 2D image signal (2D image format) (YES in BLOCK 281), itdetermines that the 2D conversion instruction is invalid. For example,when the controller 11 detects that an input image signal is a 2D imagesignal (2D image format) of a package medium (commercially available),that an input image signal is a 2D image signal (2D image format) of anon-package medium (not commercially available), or that an input imagesignal is a non-original 2D-converted image signal (2D image format), itdetermines that the 2D conversion instruction is invalid.

Then, the 2D conversion processing module 132 of the image processingmodule 13 does not convert the input image signal into a 2D imagesignal. Hence, the image processing module 13 outputs the input imagesignal intact, and the liquid crystal panel 19 displays an image basedon the input image signal (BLOCK 264, BLOCK 284). Note that when thecontroller 11 detects that an input image signal is a copyrighted 2Dimage signal, it can judge that this input image signal is a 2D imagesignal of a package medium.

(3) First recording control executed when a 3D conversion instruction isinput by the 3D conversion key 141 of the image display apparatus 1 isas follows.

When the controller 11 detects that an input image signal input to theimage processing module 13 is a 2D image signal (2D image format) of apackage medium (commercially available), the input image signal isconverted into a 3D image signal, and the 3D image signal is output bythe aforementioned fifth image conversion control (BLOCK 224). The 3Dimage signal converted by this fifth image conversion control isgenerated from the 2D image signal of the package medium. For thisreason, the controller 11 does not issue any save instruction of this 3Dimage signal. That is, this 3D image signal is deleted.

When the controller 11 detects that an input image signal input to theimage processing module 13 is an original 2D image signal (2D imageformat), which has never undergone the 2D conversion processing, of anon-package medium (not commercially available), the input image signalis converted into a 3D image signal, and the 3D image signal is outputby the aforementioned fifth image conversion control (BLOCK 234). The 3Dimage signal converted by this fifth image conversion control isgenerated from the original 2D image signal, which has never undergonethe 2D conversion processing, of the non-package medium. For thisreason, the controller 11 controls to save this 3D image signal, and thestorage device 17 receives this 3D image signal via the interface 16 andsaves this 3D image signal (BLOCK 235).

(4) Second recording control executed when a 2D conversion instructionis input by the 2D conversion key 142 of the image display apparatus 1is as follows.

When the controller 11 detects that an input image signal input to theimage processing module 13 is a 3D image signal (3D image format) of apackage medium (commercially available), the input image signal isconverted into a 2D image signal, and the 2D image signal is output bythe aforementioned sixth image conversion control (BLOCK 254). The 2Dimage signal converted by this sixth image conversion control isgenerated from the 3D image signal of the package medium. For thisreason, the controller 11 does not issue any save instruction of this 2Dimage signal. That is, this 2D image signal is deleted.

When the controller 11 detects that an input image signal input to theimage processing module 13 is an original 3D image signal (3D imageformat), which has never undergone the 3D conversion processing, of anon-package medium (not commercially available), the input image signalis converted into a 2D image signal, and the 2D image signal is outputby the aforementioned sixth image conversion control (BLOCK 274). The 2Dimage signal converted by this sixth image conversion control isgenerated from the original 3D image signal, which has never undergonethe 3D conversion processing, of the non-package medium. For thisreason, the controller 11 controls to save this 2D image signal, and thestorage device 17 saves this 2D image signal (BLOCK 275).

(5) Type determination of an input image signal is made as follows.

The controller 11 can detect based on attribute information (that in aheader) in input image data including an input image signal whether theinput image signal corresponds to an original 3D image signal (3D imageformat), which has never undergone the 3D conversion processing, of apackage medium (commercially available), an original 2D image signal (2Dimage format), which has never undergone the 2D conversion processing,of a package medium (commercially available), an original 3D imagesignal (3D image format), which has never undergone the 3D conversionprocessing, of a non-package medium (not commercially available), anoriginal 2D image signal (2D image format), which has never undergonethe 2D conversion processing, of a non-package medium (not commerciallyavailable), a 3D-converted image signal (3D image format), which hasundergone the 3D conversion processing, of a non-package medium (notcommercially available), or a 2D-converted image signal (2D imageformat), which has undergone the 2D conversion processing, of anon-package medium (not commercially available). Alternatively the imageprocessing module analyzes, for example, the frame configuration of theinput image signal, and can detect whether the input image signalcorresponds to a 3D image signal (3D image format) or a 2D image signal(2D image format). For example, based on the analysis result of theinput image signal, when it is revealed by comparing images of even andodd frames which configure the input image signal that the output formatof the input image signal is a format for alternately outputting imagesof even and odd frames for the right and left eyes, it can be determinedthat the input image signal corresponds to a 3D image signal (3D imageformat).

With the above processing, the image display apparatus 1 canappropriately control image conversion as the situation demands. Forexample, even when a 3D conversion instruction is input, if an inputimage signal is a 3D image signal (3D image format), the image displayapparatus 1 determines that the 3D conversion instruction is invalid.Then, the 3D image signal can be prevented from undergoing another 3Dconversion. Also, even when a 3D conversion instruction is input, if aninput image signal is a 2D-converted image signal (2D image format),which had previously undergone the 2D conversion processing, it can alsodetermine that the 3D conversion instruction is invalid. Thus, the2D-converted image signal, which had previously undergone the 2Dconversion processing with the considerable effort, can be preventedfrom undergoing 3D conversion.

Note that the controller 11 may control to output guidance informationwhich confirms the user as to whether or not to 3D-convert thepreviously 2D-converted image signal. If a 3D conversion instruction isinput via the input unit 14, the controller 11 controls execution of the3D conversion of the 2D-converted image signal; otherwise, thecontroller 11 does not control execution of the 3D conversion of the2D-converted image signal.

Likewise, even when a 2D conversion instruction is input, if an inputimage signal is a 2D image signal (2D image format), the image displayapparatus 1 determines that the 2D conversion instruction is invalid.Then, the 2D image signal can be prevented from undergoing another 2Dconversion. Also, even when a 2D conversion instruction is input, if aninput image signal is a 3D-converted image signal (3D image format),which had previously undergone the 3D conversion processing, it can alsodetermine that the 2D conversion instruction is invalid. Thus, the3D-converted image signal, which had previously undergone the 3Dconversion processing with the considerable effort, can be preventedfrom undergoing 2D conversion.

Note that the controller 11 may control to output guidance informationwhich confirms the user as to whether or not to 2D-convert thepreviously 3D-converted image signal. If a 2D conversion instruction isinput via the input unit 14, the controller 11 controls execution of the2D conversion of the 3D-converted image signal; otherwise, thecontroller 11 does not control execution of the 2D conversion of the3D-converted image signal.

The image display apparatus 1 can effectively use the converted 2D or 3Dimage signal while observing the copyright protection rules. Forexample, when the image display apparatus 1 converts a 2D image signalof a non-package medium (not commercially available) into a 3D imagesignal, it controls to save this 3D image signal. After that, even whenthe controller 11 detects an instruction to convert the 2D image signalof the non-package medium (not commercially available) into a 3D imagesignal, and the 3D image signal corresponding to the 2D image signal ofthe non-package medium (not commercially available) has already beensaved, it can read and play back the saved 3D image signal in responseto the conversion instruction to a 3D image signal.

Likewise, when the image display apparatus 1 converts a 3D image signalof a non-package medium (not commercially available) into a 2D imagesignal, it controls to save this 2D image signal. After that, even whenthe controller 11 detects an instruction to convert the 3D image signalof the non-package medium (not commercially available) into a 2D imagesignal, and the 2D image signal corresponding to the 3D image signal ofthe non-package medium (not commercially available) has already beensaved, it can read and play back the saved 2D image signal in responseto the conversion instruction to a 2D image signal.

Third Embodiment

Note that the aforementioned first to sixth image conversion controlprocesses have not described handling of game content. However, theimage display apparatus 1 may handle game content as follows.

(1) Seventh image conversion control executed when a 3D conversioninstruction is input by the 3D conversion key 141 of the image displayapparatus 1 is as follows.

When the controller 11 detects that an input image signal input to theimage processing module 13 is a 2D image signal of game content, itdetermines that the 3D conversion instruction is valid, and instructsthe image processing module 13 to execute 3D conversion for gamecontent. The game content has depth information required tostereoscopically display an image. The 3D conversion processing module131 executes 3D conversion for the game content (that of a firstalgorithm) based on this depth information to convert the 2D imagesignal of the game content into a 3D image signal, and outputs the 3Dimage signal.

When the controller 11 detects that an input image signal input to theimage processing module 13 is a 2D image signal of non-game content, itdetermines that the 3D conversion instruction is valid, and instructsthe image processing module 13 to execute 3D conversion for non-gamecontent. The 3D conversion processing module 131 executes 3D conversionfor the non-game content (that of a second algorithm) to convert the 2Dimage signal of the non-game content into a 3D image signal, and outputsthe 3D image signal.

(2) Eighth image conversion control executed when a 2D conversioninstruction is input by the 2D conversion key 142 of the image displayapparatus 1 is as follows.

When the controller 11 detects that an input image signal input to theimage processing module 13 is a 3D image signal of game content, itdetermines that the 2D conversion instruction is valid, and instructsthe image processing module 13 to execute 2D conversion for gamecontent. The game content has depth information required tostereoscopically display an image. The 2D conversion processing module132 executes 2D conversion for the game content (that of a firstalgorithm) based on this depth information to convert the 3D imagesignal of the game content into a 2D image signal, and outputs the 2Dimage signal.

When the controller 11 detects that an input image signal input to theimage processing module 13 is a 3D image signal of non-game content, itdetermines that the 2D conversion instruction is valid, and instructsthe image processing module 13 to execute 2D conversion for non-gamecontent. The 2D conversion processing module 132 executes 2D conversionfor the non-game content (that of a second algorithm) to convert the 3Dimage signal of the non-game content into a 2D image signal, and outputsthe 2D image signal.

Note that a 3D image described in the aforementioned first to thirdembodiments is displayed by, for example, a time-division method. Thetime-division method is a method which displays or presents a 3D imageby combining active liquid crystal shutter spectacles and a high-speeddriving display.

That is, the image display apparatus 1 can display a 3D image compatiblewith the time-division method. That is, the image processing module 13outputs images for the right and left eyes while switching them for eachframe, and the liquid crystal panel 19 (high-speed driving display)displays the images for the right and left eyes while switching them foreach frame in response to this.

The user can view a 3D image by wearing the active liquid crystalshutter spectacles. That is, the liquid crystal shutter spectaclesalternately closes shutters for the right and left eyes in response toswitching of the images for the right and left eyes for each frame, andpresent the image for the right eye to the right eye, and that for theleft eye to the left eye.

The 3D image display based on the time-division method has beenexemplified. However, other 3D display methods may be adopted. Forexample, a 3D image display method that allows the user to view a 3Dimage with the naked eyes may be adopted.

The various modules of the embodiments described herein can beimplemented as software applications, hardware and/or software modules,or components on one or more computers, such as servers. While thevarious modules are illustrated separately, they may share some or allof the same underlying logic or code.

While certain embodiments have been described, these embodiments havebeen presented by way of example only, and are not intended to limit thescope of the inventions. Indeed, the novel embodiments described hereinmay be embodied in a variety of other forms; furthermore, variousomissions, substitutions and changes in the form of the embodimentsdescribed herein may be made without departing from the spirit of theinventions. The accompanying claims and their equivalents are intendedto cover such forms or modifications as would fall within the scope andspirit of the inventions.

What is claimed is:
 1. An image conversion apparatus which is able tocommunicate with a source apparatus including a converter to convert atwo-dimensional (2D) image to a three-dimensional (3D) image, the imageconversion apparatus comprising: a three-dimensional (3D) conversioninstruction module configured to instruct execution of a 3D conversionrequired to convert an input image from the source apparatus into a 3Dimage; a determination module configured to determine validity orinvalidity of the 3D conversion instruction based on whether the inputimage corresponds to a 3D image format or a two-dimensional (2D) imageformat, or based on a cancel instruction of 3D conversion processing tothe source apparatus of the input image; an instruction moduleconfigured to instruct the source apparatus to cancel 3D conversionprocessing in the source apparatus in response to the 3D conversioninstruction, when the 3D conversion processing for converting the inputimage into the 3D image and outputting the 3D image are set in thesource apparatus; a converter configured to convert, based on validitydetermination of the 3D conversion instruction in response to the cancelinstruction which is to cancel the 3D conversion processing in thesource apparatus, an input 2D image into the 3D image in response to the3D conversion instruction; and an output module configured to output the3D image.
 2. The apparatus of claim 1, wherein the determination moduleis configured to determine validity of the 3D conversion instructionwhen the determination module determines that the input imagecorresponds to the 2D image format, the converter is configured toconvert, based on validity determination of the 3D conversioninstruction, the input image into the 3D image in response to the 3Dconversion instruction, and the output module is configured to outputthe 3D image.
 3. The apparatus of claim 1, wherein the determinationmodule is configured to determine invalidity of the 3D conversioninstruction when the determination module determines that the inputimage corresponds to the 3D image format, and the output module isconfigured to output, based on invalidity determination of the 3Dconversion instruction, the input image in response to the 3D conversioninstruction.
 4. The apparatus of claim 1, further comprising: a 2Dconversion instruction module configured to instruct execution of a 2Dconversion required to convert the input image into a 2D image, whereinthe determination module is configured to determine validity orinvalidity of the 2D conversion instruction based on whether the inputimage corresponds to the 3D image format or the 2D image format, and theconverter is configured to convert, based on validity determination ofthe 2D conversion instruction, the input image into the 2D image inresponse to the 2D conversion instruction.
 5. The apparatus of claim 4,wherein the output module is configured to output the 2D image.
 6. Theapparatus of claim 5, wherein the determination module is configured todetermine validity of the 2D conversion instruction when thedetermination module determines that the input image corresponds to the3D image format, the converter is configured to convert, based onvalidity determination of the 2D conversion instruction, the input imageinto the 2D image in response to the 2D conversion instruction, and theoutput module is configured to output the 2D image.
 7. The apparatus ofclaim 5, wherein the determination module is configured to determineinvalidity of the 2D conversion instruction when the determinationmodule determines that the input image corresponds to the 2D imageformat, and the output module is configured to output, based oninvalidity determination of the 2D conversion instruction, the inputimage in response to the 2D conversion instruction.
 8. The apparatus ofclaim 4, wherein the instruction module is configured to instruct asource apparatus of the input image to cancel 2D conversion processingin the source apparatus in response to the 2D conversion instruction. 9.The apparatus of claim 4, wherein the instruction module is configuredto instruct, when 2D conversion processing for converting the inputimage into the 2D image and outputting the 2D image are set in a sourceapparatus of the input image, the source apparatus to cancel the 2Dconversion processing in the source apparatus in response to the 2Dconversion instruction.
 10. The apparatus of claim 1, wherein thedetermination module is configured to determine, based on attributeinformation in input image data including the input image, whether theinput image corresponds to the 2D image format or the 3D image format.11. The apparatus of claim 1, wherein the determination module isconfigured to analyze a plurality of frames that configure the inputimage to determine whether the input image corresponds to the 2D imageformat or the 3D image format.
 12. An image conversion method applied toan image conversion apparatus which is able to communicate with a sourceapparatus including a converter to convert a two-dimensional (2D) imageto a three-dimensional (3D) image, the image conversion methodcomprising: instructing execution of a 3D conversion required to convertan input image from the source apparatus into a 3D image, determiningvalidity or invalidity of an instruction of a three-dimensional (3D)conversion based on whether the input image corresponds to a 3D imageformat or a two-dimensional (2D) image format, or based on a cancelinstruction of 3D conversion processing to the source apparatus of theinput image; instructing the source apparatus to cancel 3D conversionprocessing in the source apparatus in response to the 3D conversioninstruction, when the 3D conversion processing for converting the inputimage into the 3D image and outputting the 3D image are set in thesource apparatus; converting, based on validity determination of the 3Dconversion instruction in response to the cancel instruction which is tocancel the 3D conversion processing in the source apparatus, an input 2Dimage into the 3D image in response to the 3D conversion instruction;and outputting the 3D image.